Papers with causal reasoning tasks
What’s Missing in Vision-Language Models? Probing Their Struggles with Causal Order Reasoning (2026.eacl-long)
Copied to clipboard
| Challenge: | Existing benchmarks often include a mixture of reasoning questions, making it difficult to truly assess VLMs’ causal reasoning abilities. |
| Approach: | They propose two new benchmarks specifically designed to isolate and rigorously evaluate VLMs’ causal reasoning abilities. |
| Outcome: | The proposed benchmarks show that vision-language models perform poorly on causal reasoning tasks, often only marginally surpassing random guessing. |
Can Large Language Models Learn Independent Causal Mechanisms? (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) perform poorly on complex reasoning tasks, such as abstract, causal, or logical reasoning. |
| Approach: | They propose to use two concepts from causality to learn ICMs within LLMs to improve out-of-distribution performance on abstract and causal reasoning tasks. |
| Outcome: | The proposed model outperforms existing models on abstract and causal reasoning tasks and is more robust to fine-tuning. |
CausalEval: Towards Better Causal Reasoning in Language Models (2025.naacl-long)
Copied to clipboard
Longxuan Yu, Delin Chen, Siheng Xiong, Qingyang Wu, Dawei Li, Zhikai Chen, Xiaoze Liu, Liangming Pan
| Challenge: | Large language models (LLMs) have been used for a variety of tasks, including problem-solving, decision-making, and understanding of the world. |
| Approach: | They propose a review of existing methods aimed at enhancing LMs for causal reasoning . they categorize existing methods as reasoning engines or as helpers providing knowledge or data to traditional methods . |
| Outcome: | The proposed methods perform better than existing methods on a range of tasks. |
CausalityCheck: A Framework for Evaluating Causal Reasoning in Large Language Models (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing evaluation methods fail to accurately reflect a model's causal reasoning capabilities. |
| Approach: | They propose a tool to automatically generate causal reasoning checklists to assess the causal reasoning abilities of 18 large language models. |
| Outcome: | The proposed tool assesses the causal reasoning abilities of 18 large language models. |
CELLO: Causal Evaluation of Large Vision-Language Models (2024.emnlp-main)
Copied to clipboard
| Challenge: | Recent advances in large vision-language models have improved causal reasoning abilities . however, current models struggle with tasks like causal reasoning . |
| Approach: | They propose a fine-grained and unified definition of causality involving interactions between humans and objects. |
| Outcome: | The proposed model surpasses traditional commonsense causality by including explicit causal graphs . it also shows that current LVLMs can benefit from a causally inspired prompting strategy . |
CausalVLBench: Benchmarking Visual Causal Reasoning in Large Vision-Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large vision-language models have shown impressive ability in various language tasks, especially with their emergent in-context learning capability. |
| Approach: | They propose a causal reasoning benchmark for multi-modal in-context learning from large vision-language models that incorporates visual inputs. |
| Outcome: | The proposed model outperforms existing models on three visual causal reasoning tasks and demonstrates their strengths and weaknesses. |